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ABSTRACT 


In  Feller  (1968),  An  Introduction  to  Probability  Theory  and  Its  Applica- 

'i  e •£«//*>  • x y u rr,  fa  €t 

tions,  Vol.  1,  the  following  urn  model  is  discussed.  Consider^  m urns  and 


distribute  n indistinguishable  balls  among  the  urns  such  that  the  distinguish- 
able distributions  of  the  balls  all  have  the  same  probability.,^/!  n^rni~1  ). 

Let  s.  denote  the  number  of  balls  in  the  urn.  Clearly  S + . . . + S = n. 

1 m 

. V.  rl 

In  this  paper,  random  variables  of  the  type  Z = h(S., . . . ,S  ),  especially 

•5  sui>  /vi  ,|  c <. 

j ^ 5 ft,  H 

are  studied  when  mjn^  oo  in  such  a way 

L tfffotc < -i.e  I . “ 

m/nrfj?,  0 < p < ao.  Some  applications  of  the  results  in  nonparametric  1 

■,  f tc*  • n * \ f I,  v ,f  0 i r L a "''s  — * ' 


Ss«(, 


^ -;y  = h,cs,>  + ... 
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statistics  are  briefly  discussed  and  the  limit  distribution  of  max(S, ....  ,S  ) 

V -m 


is  derived.. 
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SOME  LIMIT  THEOREMS  FOR  THE  INDISTINGUISHABLE  BALL  PROBLEM 
WITH  APPLICATIONS  IN  NONPARAMETRICS 

Lars  Holst 

1.  Introduction 

In  Feller  (1968)  the  following  problem  is  discussed.  Consider  m 

urns  and  distribute  n indistinguishable  balls  into  the  urns  in  such  a manner 

that  all  distinguishable  distributions  of  the  balls  have  the  same  probability. 

What  is  the  probability  for  each  distinguishable  outcome?  A solution  is: 

place  n+m-1  balls  into  a row  and  pick  out  m-1  balls  at  random  (without 

replacement)  and  think  of  the  "gaps"  as  the  "walls"  of  the  urns.  In  this  way 

we  obtain  a distribution  of  the  balls  over  the  urns  which  is  of  the  type  above. 

As  there  are  ( n+m_1)  ways  of  picking  out  the  m-1  balls  the  probability  for 
m-1 

each  outcome  is  l/(n+m'1) . If  we  let  S,,...,S  denote  the  number  of  balls 

m-1  1 m 

in  the  urns,  we  have  thus  found  the  joint  distribution  of  (Sj, . . . , Sm ) . Note 

that  S.  + . . . + S =n  so  the  S's  are  dependent  random  variables.  In  this 
1 m 

paper  we  will  consider  random  variables  of  the  type  Z = h(Sj, . . . ,Sm>, 

especially  h(Sj, . . . ,Sm>  = h1(SJ)  + . . . + hm(Sm),  and  limit  theorems  for 

such  random  variables  when  m,n  -►  « such  that  m/n  -*  p,  0 < p < » . 

The  above  urnmodel  has  been  used  in  physics  in  connection  with 

Bose-Einstein  statistics,  see  Feller  (1968) , p.  39. 

The  urnmodel  is  also  of  relevance  for  the  two  sample  problem  in 

statistics.  Let  X,,...,X  ,(Y,,...,Y)  be  m-1  (n)  observations  from  a 

1 m-l  1 n 

continuous  distribution  Fv  (F  ).  The  problem  is  to  test  the  hypothesis 

X Y 

Hn  : F = F , i.e.  the  samples  have  come  from  the  same  parent  distribution. 

v A I 
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Let  the  X's  be  ordered  X!  < XL  < . . . < X'  . (they  are  different  with  proba- 

l 2 m-1 

bility  one)  and  let  S be  the  number  of  Y's  in  [X!  X!  ),  k = l m, 

< k-1  k 

with  Xq  = -*>,  XJ^  = +oo.  If  both  samples  have  come  from  the  same  contin- 
uous distribution  then  (S^.  . . ,Sm)  has  the  same  distribution  as  in  the  urn- 

model.  Tests  based  on  statistics  of  the  form  h.(S.)+...+h  (S  ) are  investi- 

11  mm 

gated  in  Holst  and  Rao  (1976).  Such  statistics  are  connected  with  many  non- 
parametric  tests. 

We  also  note  that  the  random  variable  (S^,.  . . , Sm>  can  be  constructed 
in  the  following  way.  Take  m-1  points  at  random  in  (0,1),  order  them,  and  let 
be  the  distance  between  the  k-lrth  and  k:th  point  (the  k:th  spacing  from 
uniform  (0,1)),  k = l,...,m  (k  = 0(m)  corresponds  to  0(1)).  Given  the  D's 
consider  m urns  and  throw  n balls  independently  into  the  urns  such  that 
the  probability  of  hitting  the  k:th  urn  is  D^.  If  is  the  number  of  balls 
in  the  k-th  urn,  then  the  (unconditional)  distribution  of  (Sj,.  . . ,Sm>  is  as 
a bove . 

In  Park  (197  3)  another  formulation  is  given  and  a limit  theorem  is 
derived  for  the  case  h^O)  = h(j),  where  h(j)  = 0 for  j > K. 

In  order  to  properly  state  limit  results  sequences  of  functions  h 's 

kv 

etc.  are  considered.  But  in  order  to  facilitate  the  notation  we  suppress  the 
index  v.  We  use  the  notation  X(Un)  — JSU)  for  convergence  in  distribution. 
N(m,Z)  stands  for  the  normal  distribution  with  mean  m and  covariance  2 
Po<\)  denotes  the  Poisson  distribution  with  mean  \ . 

We  will  always  suppose  in  the  following  that  m,n-«>  such  that 
r = m/n  — p , 0 < p < <*>  . 
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2.  The  characteristic  function. 


Let  n.hj.n,*.-.  be  i.i.d.  random  variables  with  the  geometric 
distribution 

P(n  = J)  = r/(r+l))+1,  j=  0,1,2,...  , 
where  r = m/i  . It  is  well  known  that 

r.(r,)  = l/r  , Var^)  = (r+l)/r2  . 

Let  M < m and  consider  for  a given  function  h(.  ) the  random  variable 

ZM  = h(Si’-  ' • ,SM^  ‘ 

Theorem  1.  The  following  representation  of  the  characteristic  function  of 
holds : 

itZ 

M.  -1.  n+m-1  -1.  ,..n+m  -m 

E(e  ) = (2  it)  ( ) (r+1)  • r 

n M , 

J ^Elexplithlrij, . . . ,inM)  + 10  2j(Tik-l/r))) . ((r+l-ei9)e19  r/r)M’md0  . 

-v  1 

Proof.  It  is  well-known  that  + . . . + ^ has  a negative-binomial 


distribution,  i.e. 


n/  i i v n m — 1 nii  ,v 

P(n,  + • • • + n = n)  = r (r  + 1) 

1 min 


-(n+m) 


and  that 


E(exp(it  Yj  - l/r))  = ((r  + 1 - e1  )e*  /r/r) 


10.  i0/r,.M-m 


Therefore  the  assertion  can  be  written 


M .-1 

E(e  ) = (2irP(r}  + . . . + r|  = n)) 

1 m 


ii  III 

• / E(exp(lth(ri1,  . . . , nM)  + 10  Y (\  - l/r)))d0 


1 tjf  YA 

ms 
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Hence  it  is  sufficient  to  consider  the  case  M = m. 

We  also  have  for  j,  + . . . + j = n,  j = 0, 1,  2,  . . . , 


^ = <1 "m  = 'ml  nl  * * "m  = n)  = l/("  + n " ')  ' 


or  the  conditional  distribution  of  (n,,  . . . , n ) given  t»  = n 

1 m 1 m 

is  the  same  as  the  distiibutlon  of  (S  , . . . , S ).  Therefore  we  have 

1 m 


Y p(n,  = 1,,  • • •,  = Oe 

. . i i mm 


ith(j, j ) 


!,  + • • • +Jm=n 

l m 


/P(n,  + • . • + = n)  = 

i m 


ith(S S ) 

= E ( e 1 m) 


Now  we  can  write 


f E(exp(ith(ni,  . . . , r)  ) + ie  £ (r,  - l/r))d0  = 
-w  1 


IT  00 


= / Y exp(ith(j ,j  )+i0  ^j)-  e_i  n- P(n  )d0 

__  . i _n  1 m ik  11  mm 

w J,»  • • • i ° 1 

l m 


ith(J j ) 

i m 


ii  i • • • * j_  = ® 
i m 


tt  m 

p(  hj  = Jj,  • • • , nm  = )m)  • / exp(i6(  Y ik  - n))d6  = 

-ir  1 


J,+.  • ■+)  =n 
1 m 


ith(j  , ...,)  ) 

e " ’ P(”l  = J1 "m  = ‘m>  ' 2’  = 


ith(S S ) 

= E(e  ) • P(  rj  + . . . + ti  = n)  • 2n  . 

i m 

The  above  interchange  of  summation  and  integration  is  allowed  because 
of  the  absolute  convergence  of  the  series. 


Combining  the  above  results  proves  the  theorem. 
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In  the  following  lemmas  we  consider  the  "non-random  parts"  of  the 
representation  in  Theorem  1.  Recall  r = m/n  -*  p,  0 < p<  oo,  when  m,n  -*<», 
Lemma  1.  When  m,n  -*>  *>  we  have 

(2ir)~'l(  n+^n~i)  i(r+l)n+m  r’m/mI  = ((r  +l)/r  22tt)^  - (1  + 0(l/m)  . 

Proof.  By  Stirling's  formula 

(n+m-l)-l  _ ni  (m-D'./jn+m-i)!  = 

= nn  e n(2^n)1  mm  e m (2irm)*  • m"*  • 

. . . . , .-(n+m)  n+m  ..-£  0(l/m)  _ 

(n+m)  • (n+m)  e (2iT(n+m))  • e 

= ((l+r)2w)/r  ) • r (1+r)  ■ m'  • e , 

from  which  the  assertion  follows.  ■ 

Lemma  2.  Let  M,  m -*•  « so  that  M/m  ■*  a,  0 < a < 1,  and  set 

, ...  . i0.  19/r  y . M-m 

f (0)  = ((r+1  - e ) e /r) 
n 

Then  for  each  fixed  real  number 

1 7 2 
f (4,/m2)-*  f(4<)  = exp\-(l-a)4T(pfl)/2p  ) , 


f !fn(0)ld0  - /°°  lfU<)|d4< 


Proof.  By  expanding  into  Taylor  series  we  find 

f (4,/m*)  = (1 + 4-2(r+D/2r2m  +0(m'3^2))‘m(1"M/m) 
n 

- f(4*)  = exp(-(l- a)4«2(pfl)/2p2),  n — * , 


which  proves  the  first  statement. 


W 


Let  d > 0 be  fixed,  then 


m*  / |f  (0)|d0  = m2  / (l+2(r+l)(l-cos0)/r2)'(m'M,/2de 

11  > I ® I > ^ TT>  |0|>  d 

< 2ir  m2(  l+2(r+l)(l-cos  d)/r2)  _►  o . 

For  d sufficiently  small  and  m sufficiently  large  there  exists  K_j  > 0 
and  C > 0 such  that  for  | 0 1 < d 

|fn(0)|  < (l  + Kde2)‘c’  m . 

Therefore  for  A = {0  ; m ^2  + ^7<  | 0 j < d} 

| m2  f fn(0)d0|  < J (l+K^/mf0  ’ m di|<  -*  0 . 

A m2A 

In  B = {0  ; } 0 1 < m_1/2+1/7  } we  can  use  Taylor  expansion  and  find 

1 gg 

m 2 / | f (0)  | d0  — / | f(  vp ) | dv|>  <<»  , 

B 0 -oo 


which  completes  the  proof. 


3.  Some  limit  theorems. 


First  we  give  a general  theorem. 

Theorem  2.  Suppose  that  M,m-ao  such  that  M/m—  a,  0<a<l,  and 

that  the  sequence  {h^(-  )},  for  each  fixed  real  numbers  t and  s , satisfies 

M i 

E(exp(ith  (ri1,...friM)  + is  Z ' l/r)r/((r+l)m)2) ) 

k=l 


2/o 

-as  / 2 

- H(t,s)  e , 


m — oo  , 


where  H(t,s)  is  continuous  and  H(0,s)  = l.  Then  with  Zw  = h„(S,, . . . ,S  ) 

M Ml  M 


we  have 

£(Z  . ) - £(Z  ) 
M a 

where  Z 's  characteristic  function  is 
a 

itZ  i 


itZ~  i „ 2 / 

E(e  ) = (Zrr)'2  J H(t,s)e‘s  'Z  ds  . 

-00 


Proof.  By  Theorem  1 and  Lemma  1 we  have 

itZ  . , , . i 

E(e  M)  = eo(1)  • (2")_I  • 


irm2  cr 


»»  U 1V1  1 i 

E(exp(ithM(r1l, . . . ,TiM)  + is^(hk-V’r)/(rm2))fn(4</m2<r) 

r,*  : 


-Trm2o- 


2 2 

using  the  notation  of  Lemma  2 and  a = Var(ri)  « (r+l)/r  . By  the  extended 
Lebesgue  dominated  convergence  theorem  (see  Rao  (197  3),  p.  136)  and  Lemma 
2 it  follows  from  the  assumptions  that 

E(e‘tZM)-  e-(1-“,s2/2  ds  = 

-00 

-2  r 00  - s ^ / 2 

= (2n)  2 f H(t, s)  e /£ds. 

-00 


Am 


As  H(t,s)  is  continuous  the  last  integral  is  a continuous  function  of  t . 

Thus  the  assertion  follows  by  the  continuity  theorem  for  characteristic 

functions.  ■ 

Of  particular  importance  is  the  special  case 

m 

h<si v - z w • 

where  h.( fhm(* ) are  given  functions. 

Theorem  3.  Suppose  that  M,  m -*  » such  that  M/ m -*  a , 0 < or  < 1 , and 
for  some  < 1 we  have  for  < a < 1 


where  as  a -*  1- 

A -*•  A.  and  B -►  B.  . 
a 1 a-  1 

Then 

m 2 
f(  E h^))-  NtOjAj  - Bj)  . 

Proof.  For  aQ  < a < 1 the  assumptions  of  Theorem  2 are  satisfied  and 
therefore 

itZM  — oo  2 2 

E(e  M)  — (2it)‘J  f exp(-(A  t + ZaB  ts+s  )/2)ds 

' J a or 

-oo 

= exp(-(A  - a2 B2)s2/2)  . 
a oi 

2 2 

So  HZ  ) is  N(0,A  - a B ) . In  the  same  way  we  find 

a'  a a 

^ 2 2 
HZ'M)  = t ( E \(\))  ■*  N(0,Aj-Att  - (1-a)  (Bj-Ba)  ) . 


-8- 


Now  when  a — 1 - 


2 2 

A = a B 
a a 


\ - B>  ■ 


A.  - A - (1  - «)2(B  - B2  ) - 0 . 

1 O'  IQ 

Using  an  argument  by  Le  Cam  (1958)  p.  13-14  it  follows  that 

m j 

f<W  = £<  £,  Vsk»i-  N,0<Ai  - Bi  > ■ ■ 

Particularly  simple  is  the  symmetric  case  = k = l,2,...,m. 

Theorem  4.  Suppose  that 


t h„<\> 

k=l 


y S (•nk  - l/r)r/((r+l)m)W 
for  some  random  vector  (U,V).  Then 

E,eltU  + lsV|  = G(t)  • e-<A<2^tS+s2>/2 

with  G(t)  having  no  normal  component  and 
m 

f<  £ hn<sk»  - f(Z) 


E,e“Z  , = 0(t)  e-'A  * bV/2 


Proof,  By  classical  limit  theorems  for  independent  identically  distributed 
random  variables  the  first  assertion  follows  (cf.  Le  Cam  (1958),  p.  8).  It 

is  also  easily  seen  that  the  function  H(t,s)  of  Theorem  2 is  given  by 

% -ff(At2+2Bts)/2 

H(t,  s)  = (G(t))  e 


Therefore 


itZ  . 2 2/ 

Oe  ">  = (2.)**  (CKt))*  J".-1'"1  +2<*Bts+s  )/2ds  = 


= <G(t||”  e-,oA  ' • 

By  the  same  argument  as  in  Theorem  3 the  assertion  follows. 


If  the  limit  distribution  of  ^h^rj^)  has  no  normal  component  then 


we  get: 


Theorem  5.  Suppose  that 


M Z hn<V>  - zw 

k=l  n K 

where  the  infinitely  divisible  distribution  £(U)  has  no  normal  component 


f ( £ h (S  )>  - I(U) 

ktl  n k 

3 roof.  Set 


Un  = 2,  h„<\> 
k = l 


V = (tv  - l/r)r/((r  + l)m)  / . 

n k = l K 

As  £(11^)  -*-£(U)  and  £(V^)  — N(0,1),  we  can  select  from  any  sub- 
sequence of  £(U  , V ) a convergent  subsequence  £(U  ,.V  ,)  using 
n n n'  n' 

Helly's  theorem.  Thus  by  Theorem  4 


itU  ,+isV 
n'  n 


’)  - G(t)  ■ <r(At  t2Btsts  )/2 . 


But  U has  no  normal  component  so  A = B = 0 and  Efe**^)  = G(t). 

As  the  limit  is  the  same  for  any  subsequence  it  follows  that  f(U  , V ) 

n’  n 

converges.  By  Theorem  4 the  assertion  follows.  ■ 

In  the  remaining  part  of  this  section  we  consider  the  statistic 

m 

h<S! Sn,>  ' l h<  V ' 

k = l 

for  a fixed  function  h(‘),  which  does  not  depend  on  n.  We  also 
suppose  that  m,  n -*  <»  so  that  m/n  = r = p is  fixed.  Let  r|  as 
in  Section  2 be  a geometric  random  variable  with  mean  1/p.  We  use 
the  notation 

H = Eh(n) 

ffll  = Var(h^T1^ 

ct12  = Cov(h(Ti)*  h) 

a 22  ~ Var^n^  = (p  + !)/p2 

, 2 / .1/2 

The  following  local  limit  theorem  holds. 

Theorem  6.  If  hi  n)  is  an  integer  valued  1-lattice  random  variable  with 
finite  variance  and  > 0 then 

maP(£  h(Sk)  = v)  - (2«)  * • o’^  • exp(-  ^ (v  - m»i)2/ma2  2)  - 0 , 

uniformly  in  v when  m -*». 

Proof.  Using  Theorem  1 with  M = m and  Lemma  1 we  get 


itZ  m i 

E(e  m)  = E(exp(it  Y h(Sk»)  = ( ma^/Zir )2  • (1  + 0(l/m))  • 

w m m 

• / E(exp(it  Y h(rv ) + 10  £ rv))  • exp(-in6)d8  . 

-it  1 K 1 k 


It  is  well-known  that 


IT 

P(Z  = v)  = (l/2ir)  / 
m J 


itZ 


E(e 


m\  ~ t 
)e  dt  . 


Hence  we  obtain 

P(Zm  = v)  = (mor222n)^(l  + 0(l/m))  • 

tt  it  m m 

(1/2tt)  f f E(exp(it  Y h(nk)  + io  £ nk))  • 

-TT  -IT  1 1 

• exp(-ivt  - in0)dt  d0  . 

As  above  we  have 

m m 

P^v.n)  = P (Y  h(\)  = v’  Z \ = n)  = 

tt  tt  m m 

= (1/2tt)  J f E(exp(it  Yj  h(hk)  + 19  Y \))  ' exp(-ivt  - in0)dt  d0 

-TT  -TT  1 1 

By  a multi-dimensional  local  limit  theorem  for  lattice  distributions  by 
Rvaceva,  see  Rvaceva  (19  54)  theorem  6.1,  we  have  uniformly  in  v when 
m -*  <», 

mPm(v,n)-(2»)'Vu»22-«122)'i- 

■ exp(-((v  - mfi^Ajj"!  + 0 + 0)/2(l  - <rfz/Sl<r22^  0 * 


-12- 


r 


\ 


or  using  the  results  above 

m2lp(Zm  = v)  = (1  + 0(l/m))(2irf*  • • 

•((exp(-(v  - m n)2/2<r^.2m)  +o(l))  = 

= (2ir)  ’a1>12exp(-(v  - mp)2/2ff2  z™)  + o(l)  , 

with  o(l)  uniformly  in  v.  ■ 

Remark.  The  above  approach  to  limit  theorems  for  h(S.,...,S  ) transforms 
1 i m 

the  problem  to  study  essentially  h(r|j,.  . . ,11^),  a function  of  independent 
random  variables.  Of  course  other  theorems  than  those  stated  above  could  be 
derived  in  an  analogous  manner,  e.g.  using  limit  theorems  for  2-dependence 
to  study  Yj  h(Sk,Sk+l)  ’ 


-13- 
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4.  Some  applications  in  nonparametrlcs. 

Using  Theorem  3 limit  distributions,  under  the  null  hypothesis,  for 
several  nonparametric  statistics  for  the  two  sample  problem  can  be  ob- 
tained; e.g.  the  Wilcoxon- test  and  the  run-test  is  of  the  above  type.  Such 
applications  are  considered  in  Holst  and  Rao  (1976).  In  that  paper  "close 
alternatives"  are  also  studied.  To  obtain  limit  distributions  under  such 
alternatives  seems  to  require  a different  method  of  proof  than  that  used  above. 
Applications  of  Theorems  4,  5 and  6 are  given  in  the  following  examples. 

Example  I.  For  the  geometric  distribution 

P(r)  = J)  = r/(r+l)J+1,  j = 0,1,2,.  .. 

we  have 

P(r|  > a)  = l/(r+l)a,  a =0,1,2,...  . 

Letting  I(  • ) be  the  indicator  function  we  have 
m a 

E Z l^\ <>aJ  = mP(T)>aJ  = rn/(r+l)  m = \ 
l^j  Km  m m 

where 

a = log( m/ \ )/log(r+l ) . 
m m 

If  X -•  X,  0<\<oo,  then  it  follows  by  the  polsson  approximation  of  the 

binomial  distribution  that 

m 

f(  Y lit,  > a ))  - . 

k=l  k m 

By  Theorem  5 it  follows  that 

m 

x ( Y I(S.  > a ))  -*  Po(X)  . 

k m 9 
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From  this  we  have 


P(  X «S  > am)  = 0 ) - e'X  , 

k=l 


which  is  the  same  as 

P(  max(S,,...,S  ) < a ) -►  e’X  . 

1 m ~ m 

• X 

With  X.  = e this  can  be  formulated  as 

P(max  (Sj, . . . ,Sm)  < (log(m  eX))/log(r+l))  = 

-x 

= P(log(r+l)  max  (S., . . . ,S  ) - log  m < x)  -*  e"e 
1 m — 

Thus  we  have  proved  that  the  random  variable  log((m+n)/n)  max  (S.,. . . ,S  ) - 

1 m 

log  m converges  in  distribution  to  the  usual  extreme  value  distribution, 
cf.  David  and  Barton  (1962),  p.  231,  and  Hill  (1974),  Theorem  1. 

Example  2.  Using  Theorem  4 and  similar  calculations  as  in  Example  1 we 

m 

find  that  the  statistics  max(Sj, . . . ,Sm)  and  2^  I (S^  * 0)  (i.e. 

k=l 

essentially  the  number  of  runs  in  the  combined  sample)  are  asymptotically 

independent.  The  asymptotic  distribution  of  max  (S^,.  . . ,Sm)  is  given  above. 

m 

The  asymptotic  distribution  of  2 £ I (S,  * 0)  is  the  same  as  that  for  the  run 

k=l  * 

2 2 3 

statistic  or  N(2mn/(m+n),  4m  n /(m+n)  ) . 

Example  3.  In  Holst  and  Rao  (1976)  it  is  proved  that  among  statistics 
of  the  form  considered  in  Section  3 the  Dixon -statistic 


m IS. 

z =£ 

m 1 >2 


is  in  a certain  sense  optimal.  After  some  elementary  calculations  we  find 
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V 2 = Var((  2))  “ (Cov((2)'T1))2/Var(T,)  = (1  +p)/p2  • 

As  | ^ | is  integer  valued  and  takes  the  values  0 and  1 with  positive 
probability,  the  assumptions  of  Theorem  6 are  fulfilled  and  therefore 

mip[L  ( 2k)  = v)  ” (p2/(  1 + p)2ir)2  • exp(-(v  - m/p2)  p2/2m(l  + p))  - 0 , 
uniformly  in  v when  m-*°°. 
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